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SUMMARY / ■ • ', 

Purpose o 

The goal of this study was to test the efficacy of using games 
presented on the PLATO IV instructional system to provide remedial 
mathematics training for Basic Electricity/Electronics (BE/.E) 
School trainees^' ' * ^ 

Background \ . 

• ' ^ - \ 

A considerable number of BE/E School- trainees fail due to deficiencies 
in basic mathematics* BE/E Sfchool instructors, have informally tutored 
students who have been identified as potential failures pr,ior to 
beginning their electronics study, and those who 'liaye experienced 
difficulties with requisite mathematics skills early in the curriculum. 
This tutoring has beeii conducted as instructors have been available 
and on a basis of one teacher to a group of .six to ten st-udents.^ ^ 
Student problem^ with mathematics stem from background def iciiancies, 
poor student selection -proc-edures^ and lack cf stuueau motivation 
and/or proper attitudes. 

Approach , ' o ^ 

Two learning tasks which provide the most difficulty for students 
were seledted arid ins true tionally programmed for the PLATO IV • 
system. Drill and practice routines f oj the two tasks were pre- 
pared in three methods. Two games were designed which utilized p 
PLATO IV display capabilities, along with a conventional problem . a 
presentation foUowed,«by, answer feedback routine. A group of 
students waa assigned to each of .the Qounterbalanced order of the 
independent tasks* Within each group, students received one pf the 
six possible combinatipns of the three methods (conventional' and 
two games). 

Findings and Conclusions; ^ ^ , . 

No significant differences in performance or training time measures . 
were found between the three training methods. Questionnaire data* 
. indicated that students who experienced both game mathematics 
practice ^and conventional practice definitely preferred game 
practice." They dfd not become bored or satiated with game drill, 
and expressed a definite preference for one game over the ,other. - 
The best predictor of mathematics prof iciency in this study was the 
Arithmetic 'Ifteasoning Test (ARI) score. Other student background 
measures were not as predictive. - , . . 

Effectiveness of game displays is dependent on reliable PLATO IV 
system operation. It was observed that the effectiveness of using 
games as an. instruction technique suffered more than that of the 
conventional methocj whan hardware and software operations were 
'^unstable. Due to favorable student reaction to game practice, further 
development and evaluation of instructional games are warranted. 
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^' - * INTRODUCTION ^ ' , . 

t The PLATO (Programmed Logic for Automatic Teaching Operations) 
IV computer-based education systerj has flexible graphic display cap- 
-abilities which make^student instruction highly attractive.^ A high-speed 
cpmputer linked with a, graphic pictorial display ^terminal can'pravide 
nevtf s^tiimili to. the^student. Animated gral>hics can be .designed to provide 
interesjting variety for t^he studentf, while the system stores and records 
student responses and response latencies for, later retrieval. The presen 
study explored the use of games designed for the PLATO IV. system in' 
teaching. mathematics skills to students required to complete Basic ' " * 
Electricity/Electronics (BE/E) Scl|pol.at the Naval Training €enter, 
San Diego, California. . ■ . ^ . t ' V ^ o 

' In terms of teaching methods, Suppes, Jerman, and^ Britin^s (1968^ 
program started a"new era of concern with individualized teaching. They 
identified variables for analysing ahd. predicting the response and ^ 
latency perfobnance of children solving arithmetical .problems. This 
project and others, such as Individuariy Prescribed Instruction (IPI) 
in Pittsburgh anS Westinghousje J^earning Corporation's Project PLAN, 
have all used computers to maximize individualized .instruction. More 
recently. Slough, Ellis, and Lahey (1972) have demonstra^^ed training 
time savings of 30% to 60% could be achieved using computer-a '-ited 
instruction (CAI) "Ijranching techniques rather than fixed sequc».ie 
strategy. _ 

Colemanv(1961>^has suggested that schools substitute intergroijp 
cpmpetition'tor interpersonal pompetitiou in the classroom. 'He feels 
that this change would require the creation of new form? of competition. 
Although 'games have' enjoyed pbpalarit^j in business managemeijt training', 
they haven't been fully investigated as training aids in other settings. 
Coleman thinks, motivation may be sharp^ly altered by restructuring 
rewards," and by using informal group r.ewards to reinforce training' ^ ' , 
objectives rather than impede them. 

A question which arises is why games are intrinsically motivating. 
According to Woodworth (1958),. the tendency to deal with the environment 
is 'basic 'in motivation.' He states that direction of activity toward the 
environment is "the fundamental tendency of animal and human behavior 
arid that it is the all pervasive primary motivation of behavior." In ^ 
the learning environment. Whitens (1959) theory of effectance motivation 
posits that the sjtudent. will be motivated to respond so as to make changes 
in what he is watching. It follov7s that a student will be more highly 
motivated by the change-providing situations afforded by game p^artlcipation 
than by a conventional learning environment. 

^ * " ^ 

Lutz (1973) and Lutz and Anderson ^(1973) have studied tha effect of 
what they call multimode knowledge of results (KR) in teaching letter- 
sound associations to .elementary school children. Simple knowledge of 
results consisted of only a positive audio message, whereas multimode KR 
was an audio message plus a change in the visual stimulus following a 
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correct answer. In terms of the percent of time students were distracted, 
the^multimo'de KR was significantly more effective. In o-ther words, Lutz 
found that the djmamic, changing* Rictorial« response feedback^ providea ' 
Ky PLATO IV displays caused students to attend to their learning ta'sks 
a greater percentage of the time. 

The theorized ^motivationky benefits of competitive activity and the 
.results of multimode KR have, led to the present-study, which utilizes 
pictorial "game presentations to provide jnathematics drill and practice 
sessions. In the game- versions , students* responses to practice problems 
resulted in bo.th'^continuous and accumulative^ Changes in thel^ visual 
displays. This wa& accomplished by ccmpar.ing two game presentations 
to the conventional. practice of providing straight problems followed * 
*by feedback presentations to determine whethet the game f orm 'q^f drill 
and practice wcfuld prove superior. Conventional mathematics practice " 
v/as compared with ongoing game competition between tbo student and 
the PLATO IV system; 

' ' , METHOD ^ ' . 

Design 

r ' • * " 

* ' p* ■( * 

Conventional^ practice was compared with two types of games, '^ug-of-war 
and speedwayt A counterbalanced 'design was used to investigate the effects 
of 'the three training methods on perf oinnance. Two tasks — powers-of-ten 
and formula solving — provided the subject matter for the study. Subjects 
were split into two groups to control the sequence in^which the tasks were 
done. iWithin each group, •each student was g*iven a difterent training 
"method*" fot each of tHfe.twb games (Table 1). 'Thus, in Group II, the "CS" 
students used conventional practice for formula solving and speedway 
for powers-of-ten. Random assignment of 48 students to the six combina- 
tions of training methods 'yielded four students per combination* in each 
counterbalanced task group. 

Subjects ^ 

All 48 students were Navy trainees in" the Basic Electricity/Electronics 
(BE/E) School, Service School Command, Naval Training Center, San Diego, 
California. Students were selected who ne6ded strengthening, pf mathematics, 
skills. Participation in the study was voluntary. ^ Students utilized 
were those who had not begun the individualized BE/E curriculina or who 
had -started the beginning materials and were experiencing difficulty 
solving problems. \ . » ' ' 

Equipment 

The two' learndng tasks were presented on PLATO IV, an instructional 
time-sharing system headquartered at the University of Illinois (UI), 
Urbana, Illinois. The present study was conducted on 12 student terminals 
located at the Nav^l Training Center, San Diego, California. 



- .TABLE 1 •* •. 

Assignment oi.Students , 



Group I 
N=2A 



Gr9up^II 
N=24 . 



' 1 



■Task' 



A 

Powers-of-ten 


Formula Solving 


Method Combinations Used 'In Each. Group* 


1. CS 


4. ST\-t- 


2. CT- - 


5/ TC 


3.' SC- ■ 


t, 6. .tS - 



,1 



Task' 







FormulaXSolvlng 



Powers-bf-ten 



*C = Conventional ?r«c'tic 
T = Tug-of-war-^ Game 
S = Speedway Game 



f Operatiorj' Of tKe- PLATO 'IV system" is controlled bV a large CDQ 6400 
computer system located at UI. ^ Communication with teminals in San Diego 
is via,-Volce. grade telephone lines. Three Lines. are used, each of which 
are t:erminate"a in Sah Diego with a multiplexer. Each multiplexer services 
four terminals. The average tliae for a Student entry to Be sent to 
the computer, prpcessed, and returned afnd displayed on the terminal in 

• San Diego is 212 milliseconds., r ' . , 

j ' ' . * ^ V. • ' 

.The PLATO IV student terminal "(Figure ).) is an interactive computer . 
graphics terminal with an 8. 5-square-inch plasma display panel. The 
terminal permanently stores information -on the display 'screen which 'does 
not require .refreshing by the computer... Characters, appear on the screen 
at a speeH of ISO characteis per secbnd with a' capacity of 2, OAS characters. 
Fine drawing speed: is in excels of 600* inches per second. ^ There are 252 
characters available, 126 of which "are alterable via the computer program. 
A random-access slide^pro jector vithin each terminal is used 'fbr^rear 
projection of static information on the display screen. Student 'terminals 
accommodat;e random-acces^ audio response unites and have^ additional input- 
output channels for controlling, auxiliary equipment.. Stifle (1970 and 
1971) provides a more detailed PLATO IV system and terminal description. 

*■ • * ' 

Courseware ^\ ^ , \ \ - ^ ' 

Two* learning tasks were used in this >tudy~p6wers-of-ten and formula 
solving. Powers-of-ten,iijvblves,learplng how to. add,, ..subtract , multiply-, • 
divide, square,, and extract .square roofs of^numb^rs expressed^as t)owers- 
of -ten. 



^Formula solving require^ that the student transpose formulas '^such 
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' nF.ig. 1. PLATO IV Student Terminal 

as Ohm's Law (E =^ IR) or reactance formulas (e.g., Xj^ = 27rFL) correctly^ 
to solve for an unknown value. The skills required ar-e direct substitu- 
tion into fo.irmulas, correct placement of the decimal p.oint, and identlfica 
tion*and correct use, of metric prefixes in problem solving. . . 

A set of rules for reaching the objectives of both tasks was made 
available to the students (Figure 2). The rules for both tasks consisted 
of explanatory information presented in fixed sequence with examples of 
problem types to be solved during practice sessions. The course design 
required students to complete practice sessions for both tasks.' Review 
of rules was optional before the practice session and between practice 
rounds (see Figure 2). ~ ' . 

The three training methods employed in the risk practice sessions 
ware conventional, tug-of-war game, and speedway ^ame practice. Within 
each task, identical problems were presented to students in each of 
the, three methods.' The amount of answer feedback was the sam3 for 
each of the three methods. 

In conventional practice, the problem was presented to the ^student, 
he responded via the keyboard, and ansv/er feedback appeared. The only 
screen display. the student saw was the problem, a cursor where his answer 
was accepted, and a correct or incorrect evaluation after he entered an 
answer . 

Tug-of-war game practice consisted of the same problem presentation 
as conventional practice, in addition to a display showing a tug-of-war 
g?»nse (Figure 3). The student competed against PLATO (his opponent) and 



Introductory 
Lesson 



,<: 




Group I 




Group II 



^Powers-of- 
Ten 




Rules^ 



Practice 



I 



Round 1 



Rules . 



I 



Round 2 



I 



Formula. 
Solving 



Rules 



Practice 



I 



Rules 



Round 2 



Formula 
Solving 




Rules 



Practice 



I 



Round 1 



Rules 



I 



Round 2 



Lesson 
Test 



Fig. 2. Review Mathematics Lesson Design 
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Ten 




Rules 



Practice 



IRound 1 



1 Rules . 1 


Round 2 







Questionnaire 
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Pig. 3. Tug-cf-war Game Display 



received a man for his team when answering correctjly. If the student 
answered Incorrectly, PLATO added a man to his side of the tug-of-war. 
At the end of Round- 1 (five problems), the team with the most men pulled 
the other team into the ocean to be consumed by an octopus appearing on 
the game display. At the end of two rounds (ten problems)^ there was a 
tug-of-war between the men accumulated over both rounds by the student 
and his opponent, PLATO. « . 

The speedway game was also a cbmpetltlon between the student 
and the system. In this game, two race cars were displayed on the screen, 
one identified as the student and the other as PLATO (Figure 4). For 
each of the problems solved correctly, the student *s car advanced a 
predetermined distance towards the finish line. An Incorrect answer 
moved PLATO *s car ahead. Again, after five problems or Hound 1, whichever 
car is ahead, PLATO *s or the^ student's, races to the finish" line to leave 
his opponent in the ^ust! At the end of Round 2 (ten problems), both cars 
race. The result i8***determined by their cummulative score over Rounds 
1 and 2. . 

Evaluation Measures 

A lesson test was used to evaluate student proficiency in the two 
tasks — powers-of-ten andr'formula solving. The test was 16 multiple- 
choice items, with eight devoted to each task. The purpose of this test 
was to measure the relative effectiveness of the three training 
methods as reflected by student achievement scores. 
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Fig. 4. Speedway Game Display . , 

Student background measures were also obtained. These included 
his scores on the General Intelligence Test (GCT) , Mathematics Reasoning 
Test (ARI), Mechanical Aptitude Test (MECH) , Electronics Aptitude Test 
(ETST), and the ',20-it^ math test taken prior to entering BE/E School. 

Students completed 'questionnaires designed to assess their attitudes 
about the training methbd^u- the PLATO system, and the learning environ-^ 
ment they .experienced, t 

■ ■ " \ ^ : 

Procedure \ \ 

^ \ . ' \ ' ^ 

After the general ilature of the experiment was explained to the 
students, they were ran4omly assigned identification numbers. These 
numbers determined .each/ student's task group and training method order. 
Prior to beginning the lesson, students "took a short introductory 
lesson which explained the use of the terminal keyboard and provided 
some practice. Students were instructed not to collaborate, and to work 
at their own pace. » 

After completing bbth tasks and the lesson test, the students re- 
ceived their test scores and on-line corrective feedback. Then the 
students were given a questionnaire to complete.. This .concluded the 
experimental session. 

RESULTS 
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Perf ormance Measures " 

Lesson Test . Mean performance measures are sqmmarized in Table 2. 
multivariate (variance and covariance) analysis (Biomedical Computer 




Performance 
Measures 



Method 



Power s~of- ten 



Formula Solving 



'ist* 2nd 1st 2nd 

-(Group 1) (Group 2) (Group 2) (Group 1) 





Conventional 


83.3 


81.2 


46.7 


47.5 


Test ^ 
Score (X) ' 


Speedway 
Tug-of-war 


65.1 
84.5 


75U 
76.8 •• 


57.3 
55.6 


42\2 

CO A 
J J . U 




Conventional 


25.1 


20.5 


19.8 


24.2 


Lesson 
Time (min) 


Speedway 
Tug-of-war 


30.7 
28.7 ■ 


17.0 
27.4 


29.3 ' 
24.7, 


26.1 
27.6 


1 


Conventional 


35.0 


30.1 


50.9 


52.4 


Lesson 
Score ,(%) 


Speedway 
Tug-of-war 


37.3 
29.2 


40.7 
28.4 


56.2 ' 
46.1 . 


44.1 
58.4 


*Powers-of- 


■ten training given 


before 


formula solving 


trainingv 





4 

Program Series, UCLA, BMD12V) was completed on test scores for' both' tasks 
CTable 3). The largest dif&^nce between methods is geen in the powers- 
of-ten task. .However, it was not significant. Th^ ARI^ scores contributed^ 
the largest difference between students for both tasks' (p < 0.05). 

' 4" • 

Lesson Time . Lesson time recorded included practice time spent 
by students on each of the two tasks. Here, there was a significant 
difference between groups on the powers-of-ten task^. Group I, which did 
power s-of -ten first, was slower (p < O.OSj. GCT accounted for the greatest 
source of covariation between students on the formula-solving task. ^ 
The BE'AE School's math test also accounted for a significant amount of 
student variation in time required to complete the formula-solving task. 

Lesson Scores . Within each task, a record kept of the percentage 
of correct student responses- yielded an overall method or task score 
(Table 3). A significant interaction between method and group (MxG) 



c 

TABLE 3 

Analysis of Covarlance for Pefformahc'e^ Measures 



F Ratio 



Source 


df 


Test 


Score 


Lesson 


Time 


Lesson 


Score 


Pwr-Ten 


Fr-Solv 


Pwr-Ten 


Fr-Solv 


Pwr-Ten 


Fr-^Solv 


Method 


2 


2.24 


<1.0 


<1.0 


1.81 


1.19 


<1.0 • 


Group 


1 


<1.0 


1.05 


4.20* 


<1.0 


<i.o 


<1.0 


M X G 


2 


1.13 


<1.0 


1.20 


<1.0 


<1.0 


4.34* 


Covarlates : 


5 














GCT 


1 


<1.0 


1.36 


<1.0 


6.66* 


1.17 


4.74* 


ARI 


1 


6.39* 


5.85* 


<1.0 


i.l9 


4.71* 


-7.59** 


MECH ' 


1 


1.46 


<1.0 


<1.0 


1.98 


2.00 


<1.0 


ETST 


1 


<1.0 


<1.0 


<1.0 




3.16 


1.35 


Math Test 


1 


<1.0 


<1.49 


<1.69 


-.4.59* 


<1.0 


1.09 


"Error 
Variance 


37 


246.74 


.343.28 


117.09 


67.68. 


282.95 


116. "50 



*p < 0.05 
**p < 0.01 



occurred, since Group I students achieved much higher formula-solving 
scores during speedway game practice. This tos a reversal. of results 
of the formula-solving, conventional, and tug-rof-war practice sessions^-, 
where 'Group I students scored lower t.}ian Group II students. Here again, 
ARI scores provided the major source of differences between student per- 
formance on the formula-solving and powers-of-ten tasks, p < 0.05 and 
p < 0.01 respectively. GCT scores covarled significantly with formula- 
solving performance (p < 0.6.5). 

Correlational Analysis - 

Correlation analyses were performed between the student test scores 
(GCT, ARI, MECII, ETST, and math test) and student performance measures 
(Table 4). ARI scores "proved to be the best overalrlr^predictor of per- 
formance and GCT scores were the weakest predictors. 'of test and lesson 



TABLE 4 

Correlation Between Background keasures and Performance* 



/ 



Background . Test Score Lesson Time Lesson Score 

Measures Pwr-Ten Fr-Solv Pwr-Ten Fr-Solv Pvrr-Ten Fr-Solv 

GCT 0.036 0.079 -0.142 -0.377 0.070 0.015 / 

General / 
Intelligence 
" Test 

. / 

ARI • 0.279 0.557 -0.292 -0.332 0.509 0.578/ 

Math / 
Reasoning 
Test 

MECH -0.259 0.109 0.062^ -0.001 -0.023 X 0.091 

Mechanical • / • 

Aptitude ^ / 

ETST 0.055 , 0.377 -0.175 -0.235. 0.;383 0.392 

Electronics / ^ 

J^g^titude 

Test " ^ 

Math Test 0.037 0.486 -0.244 -0.387 0.384 ^0.455 

Given to . / 

all students 
entering BE/E 
School 

*Correlatlon coefficients >_ 0.32 are significant at p < 0.05. 

scores.' The BE/E School's math test scores were less efficient for pre- 
dicting performance than the ARI scores. 

Student Attitude Questionnaire 

As can be seen from the questionnaire responses (Table 5), students' 
reactions to game practice were very positive. Of the students who 
experienced both games, those in method combinations 4 and 6 (Table 1) 
expressed a definfte preference for tug-of-war game practice over speedway 
game practice. Besides the game aspect of practice,- students were aware 
of what the training objectives were and felt that the material was pre- 
sented effectively. Pearson r's calculated between ratings of Questions 
3 and 4 (assigning "1" to 0% and poor, and "5" to 100% and outstanding) 
and- lesson test scores yielded 0.226 and 0.270 respectively. 
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TABLE 5 

Responses to Evaluation Questionnaire 



. Question 


Response Frequency 


1. Which type of problem solving 
did/would you prefer? 

^ ' N = 48 


Regular Practice 

^ L4 


Game Practice 

34 . 
p<0.006 (Z score, 
2-tailed) 


2. If you played both tug-of-war 
and speedway games/ which did 
you prefer? N = 16 
(Applicable to Groups o) 


Speedway 

2 


Tug-of-war 

^ . 14 

p<0.003 (Z score, 
2-tailed test) 


3. In future lessons, what part * 

of problem-solving practice* 

would you like to be in game 

.form?" ,Q 

N = 48 


4 

^0-10% ' 
X-=3.6 
p<0.10 


7 
25% 


1-5 

50% 

2.5 


12 

75% 

0.4 


10 
, 100% 
0 


4. Rate the instructional 

effectiveness of the train- 
'^ing materials. 

N = 42 


1 

Poor 

■x^=6.50 
p<0.025 


Fair 
2.3 


12 
Aver- 
age 

1.54 


15" 
Above ' 
aver- 
age 
5.18 
p<0.025 


10 • 
Outstand- 
ing 

0.30 


5. How well did you understand 
what you were supposed— to- 
le^rn, (i.e., how clear 
were the training objec- 
tives)? 

N = 42 


2 

^ 0% 
X =4.88 

' p<0.05 


3 

■ 25% 
3.47 

p<0.10 


12 ' 

50% 

1.54 


-15 . 
75% 
5.18 

■p<0.025 


• 11 

100% 

0.80 


6. The instructional material 
was presented too quickly 
(needed smaller steps). 

N - 42 


Never 
'X^=0.04 


-l-U 

Occa- 
sion- 
ally 
0.30 


Fre- 
quent- 

ly 

1.54 


Q 
o 

Usually 
0.01 


Always 

3.47 
p<0.10 


7. Too much material was pre- 
sented at one time on the 
screen (screen was crowded). 

N = 42 


18 
Never 

X^=10.97 
p<0.005 


16 
Occa- 
sion- 
ally • 

6.88 
p<0.01 


7 

Fre- 
quent- 
ly 
0.23 


. 0 

Usually 
0 


1 

Always 

6.50 
p<0,025 


8. Arrangement (spacing, format, 
distribution, etc.) of 
,mater-ials on the screen was 
excellent. 

■ N = 42^ 


' 6 
Never 

X^=0.69 


, 2 
Occa- 
sion- 
ally 

4.88 ' 
p<0.05 


3 

Fre- 
quent- 

ly 

3.47 

p<OilO 


10 
Usually 

0.30 


21 
Always 

18.90 
p<0.005 



PLATO System Operation 



^ Table 6 summarizes the experiences of students during this study. 
Two major types of transmission problems occurred which Interrupted 
student progress at various terminals. 

The first problem occurred when transmission of data betvzeen the 
student terminal In San Diego and the computer .In Urbana, Illinois became^ 
"garbled'' and the student^s display was distorted. This resulted in 
.(1) eliminating the tug-of-war or speedway display entirely causing the 
game score to register inaccurately, (2) "clobbering" the display on 
the student *s screen so that it was not readable, or (3) stalling the 
student *s terminal so that additional^ keyboard entries would not advance 
the lesson program. These failures were limited usually to one or two 
terminals at one time. Usually the experiment proctors were able to 
restore screen displays by entering certain commands at the affected \ 
student's key^^oard. 

The second major operational problem was the shutdown of total system 
^operation without the cognizance of study proctors. This resulted in 
the loss of student perf 6nuance data described previously. . In these 
cases, the affected students were eliminated frcm the study and their 
Identification numbers were returned to, the pool and drawn by replacement 
students. In addition, the performance data' recording program mal- 
functioned twice due to overflowing available storage space and program 
switching errors. The latter conditipns were rectified at the San Diego 
experimental site. 

Student data recovered and the overall operational experience during 
the study is summarized in Table 6. .The experimenters took precautions 
to optimize system! operation at all times. Questionable student records 
were, discarded and replaced by those generated by students in later trials. 

DISCUSSION AND CONCLUSIONS 

The results indicated that game practice is not superior to convien- 
tlonal practice and that there is no significant difference between the 
two different game presentations. Whatever motivational benefits may 
be attributed to g^me practice in terms of test score, lesson time, and 
lesson score was not apparent with these experimental tasks. The alleged 
benefits of Instrlnslc motivation and the dynamic, changing pictorial 
response feedback characteristics of the tug-of-war and speedway games 
did fet manifest themselves in this study as measured by the selected 
depmdent measures. It may be that a measure such as distraction time 
"or Hme attending to the visual display (as in the Lutz (1973) study) 
would have pointed to differences between methods. 

Student evaluation of game practice was excellent. As can be seen 
from Table 5, there was a definite preference for. game practice (Question 1) 
and for tug-of-war over spefedway (Question 2). It is likely that the 
tug-of-war game held more suspense for students and had more climactic 
>humor than the speedway game. On the questionnaire, students were 
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encouraged to make general comments. Students did not feel that, the 
games were too simple, or that they had been insulted by being taught . 
-^"down to" with game practice. This .was a concern in the selection and 
development of the games. The "author *s intent was to use displays that , ^ 
were interesting and that did not have game rules that were more com- 
plicated than the. subject matter itself.^ Apparently this objective 
was met. ' * 

Answers to Questions 3 and 4 were not appreciably biased by reporting 
performance scores to the students before they completed the questionnaire. 
This was indicated by the low correlations of 0.226 and 0.270 between 
total lesson score and ratings on these questions. Answers to Question 
5 showed' that most of the students understood what the lesson, objectives 
were. Thirty-eight responses out of 42 ranged from "understood" (50%) 
to "completely understood" (100%). , : 

In contrast, answers to Question 6 indicated that the instructional 
material was .presented too quickly and that most students desired smaller 
instructional steps. As a result, the general rules available were reviewed 
frequently. During the study, Group I .students"utiiized the rules^71 times 
and Group II students 56 times. Apparently the amount and arrangement of 
material on the. display screen was satisfactory and independent of in- 
structional step size (Questions" 7 and '8). ^ 

BE/E School's math test did not predict performance on the review 
mathematics lessons in this study as well as the traditional ARI test 
scores. Interestingly, mechanical aptitude scores correlated negatively 
with powers-of-ten test and lesson performance scores (Table 4). All 
background measures predict formula-solving performance better than powers- 
\of-ten test scores, with OCT correlating .less with all performance 
measures than the^other background tests. \ 

Undoubtedly, game practice suffered more than the conventional 
practice from transmission problems between the central computer and 
student .terminals. As can be seen from Table 6, during Student Trial 
Numbers 2, 3, 6, and 8, students' displays had to be restored so that the ^ 
students could continue their progress. This type of disruption as well 
as total system shutdowns affected game practice more than conventional 
because the cumraulative scoring and display continuity of the game was 
interrupted. Unfortunately, it was not possible to accurately record 
at what point in the' lesson the interruption occurred since- the student 
often did not realize his presentation was in error until some tline later. 
However, disruptions did not deteriorate student attitudes, as measured 
by the evaluation questionnaire (Table 5), or as reflected by comments 
to study proctors. However, ^.more stable system operation undoubtedly 
would enhance the effectiveness of instructional games. 

Due to favorable student reaction to game practice, further develop- 
ment and 'evaluation of instructional games are warranted. Application 
of games to different tasks 'of Jonger duration might be revealing. 
Competition between students rather than between a student and a CAI' 



system may prove more effective. Game complexity should be systematically 
varied and evaluated. Monitoring physiological indices of student 
performance may provide further insight^ into the effect of the dynamic 
visual stimuli characteristic of computei--based instructional games. 
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